"Can you give me another word for hyperbaric?": Improving speech translation using targeted clarification questions
نویسندگان
چکیده
We present a novel approach for improving communication success between users of speech-to-speech translation systems by automatically detecting errors in the output of automatic speech recognition (ASR) and statistical machine translation (SMT) systems. Our approach initiates system-driven targeted clarification about errorful regions in user input and repairs them given user responses. Our system has been evaluated by unbiased subjects in live mode, and results show improved success of communication between users of the system.
منابع مشابه
Enriching machine-mediated speech-to-speech translation using contextual information
Conventional approaches to speech-to-speech (S2S) translation typically ignore key contextual information such as prosody, emphasis, discourse state in the translation process. Capturing and exploiting such contextual information is especially important in machine-mediated S2S translation as it can serve as a complementary knowledge source that can potentially aid the end users in improved unde...
متن کاملModelling Human Clarification Strategies
We model human responses to speech recognition errors from a corpus of human clarification strategies. We employ learning techniques to study 1) the decision to either stop and ask a clarification question or to continue the dialogue without clarification, and 2) the decision to ask a targeted clarification question or a more generic question. Targeted clarification questions focus specifically...
متن کاملWhy Clouds Give Me a Case of the Vapors
A ccording to Apple, “ ... certain celebrity accounts were compromised by a very targeted attack on user names, passwords, and security questions.”1 Didn’t we cover defensive privacy tactics in my January column?2 Color me dazed and confused! Hacking in cyberspace? Nothing like that’s ever happened before. (I’ve got another heads-up for you iPhone users—Siri talks about you behind your back. I’...
متن کاملImproving Speech-to-Speech Translation Using Word Posterior Probabilities
Nowadays, speech translation is a research problem in machine translation. The problem arises as to how to combine speech recognition and machine translation in a suitable way. Some authors have shown that the speech translation can be improved by using word lattices as input of the translation system. The acoustic recognition scores from the word lattice are used for improving the translation ...
متن کاملThe language components in Verbmobil
This paper gives an overview over the main problems and their solutions in the language components of the Verbmobil speech translation system. Interpretation of spontaneously spoken language has to take into account that syntax and semantics differ from written language, that punctuation is missing, that accent and intonation have effects on the meaning and the translation, that the output of t...
متن کامل